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A transverse Hamiltonian variational technique for open quantum 
stochastic systems and its application to coherent quantum control* 

Igor G. Vladimirov^ 

Abstract 

This paper is concerned with variational methods for nonlinear open quantum systems with Markovian dynamics governed 
by Hudson-Parthasarathy quantum stochastic differential equations. The latter are driven by quantum Wiener processes of the 
external boson fields and are specified by the system Hamiltonian and system-field coupling operators. We consider the system 
response to perturbations of these energy operators and introduce a transverse Hamiltonian which encodes the propagation of 
the perturbations through the unitary system-field evolution. This provides a tool for the infinitesimal perturbation analysis and 
development of optimality conditions for coherent quantum control problems. We apply the transverse Hamiltonian variational 
technique to a mean square optimal coherent quantum filtering problem for a measurement-free cascade connection of quantum 
systems. 

I. INTRODUCTION 

The Hudson-Parthasarathy quantum stochastic calculus [9], [11], [22] provides a unified framework for modelling the 
dynamics of open quantum systems interacting with environment. The governing quantum stochastic differential equations 
(QSDEs) are driven by a quantum counterpart of the classical Wiener process which acts on a boson Fock space and models 
a heat bath of external fields. An important feature of the QSDEs is that their drift and dispersion terms are specified by the 
Hamiltonian and coupling operators, which describe the energetics of the system and its interaction with the environment, 
and also involve a scattering matrix representing the photon exchange between the fields [22]. These energy operators are 
usually functions (for example, polynomials or Weyl quantization integrals [4]) of the system variables, and the form of this 
dependence affects tractability of the resulting quantum system. 

In particular, quadratic Hamiltonians and linear system-field coupling operators lead to a class of open quantum harmonic 
oscillators (OQHOs) [3], [5] which play an important role in the linear quantum control theory [2], [14], [25]. The linear 
dynamics of such systems are relatively well understood and are similar to the classical linear SDEs in some regards, such 
as the preservation of Gaussian nature of quantum states [12], [23] driven by vacuum fields. Nevertheless, the coherent (that 
is, measurement-free) quantum analogue [21] of the classical LQG control problem [1], [16] for OQHOs is complicated 
by the physical realizability (PR) constraints on the state-space matrices of the fully quantum controller which come from 
the special structure of QSDEs mentioned above. Similar constraints are present in the coherent quantum filtering (CQF) 
problem [20]. 

One of the existing approaches to the coherent quantum LQG (CQLQG) control and filtering problems employs the 
Frechet derivatives of the LQG cost (with respect to the state-space matrices subject to the PR constraints) for obtaining 
the optimality conditions [28], [29] and for the numerical optimization [26]. This approach takes into account the quantum 
nature of the underlying problem only through the PR constraints, being “classical” in all other respects, which has its own 
advantages from the viewpoint of well-developed optimization methods. However, a disadvantage of this approach lies in 
the fact that it is limited to certain parametric classes of linear controllers and filters. In particular, the resulting optimality 
conditions do not provide information on whether nonlinear quantum controllers or filters can outperform the linear ones 
for linear quantum plants. 

In the present paper, we outline a fully quantum variational technique which allows the sensitivity of the dynamic and 
output variables of a nonlinear quantum stochastic system to be investigated with respect to arbitrary (that is, not only 
linear-quadratic) perturbations of the Hamiltonian and coupling operators. This approach is based on using a transverse 
Hamiltonian, an auxiliary time-varying operator which encodes the propagation of such perturbations through the unitary 
system-field evolution. This leads to an infinitesimal perturbation formula for quantum averaged performance criteria (such 
as the LQG cost functional) which is applicable to the development of optimality conditions in coherent quantum control 
problems for larger classes of controllers and filters. In particular, this approach allows the sensitivity of OQHOs with 
quadratic performance criteria to be studied with respect to general perturbations of the energy operators. In fact, the 
transverse Hamiltonian method has already been employed in [31] to establish local sufficiency of linear filters in the mean 
square optimal CQF problem [29] for linear plants with respect to varying the energy operators of the filter along Weyl 
operators [4]. Note that our approach is different from [7] which develops a quantum Hamilton-Jacobi-Bellman principle for 
a measurement-based quantum feedback control problem, where the role of state variables is played by the density operator. 
It is also relevant to mention a parallel between the presented perturbation analysis and the fluctuation-dissipation theorem 
[17]. 
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The paper is organised as follows. Section HU outlines notation used in the paper. Section [HI] specifies the class of open 
quantum systems in Hamiltonian formulation. Section |IV] discusses sensitivity of OQHOs to parametric perturbations within 
quadratic Hamiltonians and linear system-field coupling operators. Section [V] introduces the transverse Hamiltonian. The 
latter is used in Section |Vl] for perturbation analysis of system operators. Section IVIII extends the transverse Hamiltonian 
technique to quantum averaged performance criteria. Section IVIIII applies this approach to a mean square optimal CQF 
problem. Section makes concluding remarks. 

H. PRINCIPAL NOTATION 

In what follows, [A,B] : = AB — BA denotes the commutator of linear operators A and B on a common space. As a linear 
superoperator, the commutator with a fixed operator A, is denoted by adA(-) := [A, •]. This extends to the commutator (n x m)- 
matrix := for a vector X of operators X\,...,Xn and a vector y of operators 

yi,...,y„,. Vectors are organized as columns unless indicated otherwise, and the transpose (•)^ acts on matrices of operators 
as if their entries were scalars. In application to such matrices, (•)^ := ((•)^)^ denotes the transpose of the entry-wise 
operator adjoint {■)*. For complex matrices, is the usual complex conjugate transpose (•)* := ((•))^- The subspaces of 
real symmetric, real antisymmetric and complex Hermitian matrices of order n are denoted by S„, A„ and H,, := S„ 
respectively, where i := v/—T is the imaginary unit. The real and imaginary parts of a complex matrix are denoted by Re( ) 
and Im(-). These extend to matrices M with operator-valued entries as ReM = j{M +M*) and ImM = ^(M —M*) which 
consist of self-adjoint operators. Positive (semi-) definiteness of matrices and the corresponding partial ordering are denoted 
by ()=) Also, S+ and 1HI+ denote the sets of positive semi-definite real symmetric and complex Hermitian matrices of 
order n, respectively. The tensor product of spaces or operators (in particular, the Kronecker product of matrices) is denoted 
by (g). The tensor product A0B of operators A and B acting on different spaces will sometimes be abbreviated as AB. The 
identity matrix of order n is denoted by /„, while the identity operator on a space H is denoted by J^//. The Frobenius inner 
product of real or complex matrices is denoted by {M,N) := Tr(M*V). The expectation := Tr(p^) of a quantum variable 
^ over a density operator p extends entrywise to vectors and matrices of such variables. 

III. OPEN QUANTUM STOCHASTIC SYSTEMS BEING CONSIDERED 

Consider an open quantum system which interacts with a heat bath of m external boson fields and is endowed with n 
dynamic variables (f),... ,Y„(r) evolving in time f ^ 0. The system variables are self-adjoint operators on a composite 
system-field Hilbert space where M’ is the initial space of the system which provides a domain for (0),..., Y„(0), 

and is a boson Eock space [22] for the action of quantum Wiener processes W\{t),... ,Wm{t). The latter are self-adjoint 
operators which model the external boson fields. The energetics of the system-field interaction is specified by the system 
Hamiltonian //(f) and the system-field coupling operators Li (f),... ,L,„(f) which are self-adjoint operators, representable as 
time invariant functions (for example, polynomials with constant coefficients) of the system variables Xi{t),... ,X„{t). Both 
//(O) and L] (0),... ,L,„(0) act on the initial space Eor what follows, the system and field variables, and the coupling 
operators are assembled into vectors: 


Xiit) 


'Wi{ty 




, W{t) := 


, Lit) := 


Y„(f)_ 


Wm{t)_ 


L>m (0 


Depending on the context, a system operator <7, acting on the initial space will sometimes be identified with its extension 
(7 (g) to the composite system-field space Jif (g) The system and the fields form an isolated entity which undergoes a 
unitary evolution U{t) on M ’driven by the system-field interaction according to the following QSDE [11], [22] with 
initial condition I/q := 

dt/(f) = -(/(//odf-PLjdW(f)) + iLjnLodf)t/(f), (2) 

which corresponds to the Schrodinger picture of quantum dynamics. Here and in what follows, the initial values of time- 
varying operators (or vectors or matrices of operators) at f = 0 are marked by subscript 0 (so that //q := //(O), Lq := L{Q) 
and Uq:=U (0)), while the time dependence will often be omitted for brevity. The QSDE (|2]i corresponds to a particular yet 
important case of the identity scattering matrix, when the photon exchange between the fields and the gauge processes [22] 
can be eliminated from consideration. Here, Q. := G H+ is the quantum Ito matrix of the Wiener process W: 

dWdW'^ = ndf, Q.:=I„, + iJ, (3) 


where the dimension m is assumed to be even, and the matrix J G Am specifies the cross-commutations between the quantum 
Wiener processes Wi,... ,Wm. 


[dW,dW'^] = 2iJdt, J := J(g)/„/2, 



1 

0 


(4) 
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Accordingly, the term LjdlV in (l2]i can be interpreted as an incremental Hamiltonian of the system-field interaction, while 
jLjnLodf is associated with the Ito correction term in the differential relation d{UU^) = {dU)U^ + UdU^ + {dU)dU^ = 0 
describing the preservation of co-isometry of U (f). The system variables at time f ^ 0, as operators on the system-field space 
0 are the images 

Xk{t)=itiXk{0)) (5) 


of their initial values under the flow jt which maps a system operator Oq on the initial space to 

a(f) :=jr((Jo) = U{tyiao0^^)U{t). (6) 

Note that, in view of (|2]i, the flow j, depends on the energy operators Ho and Lq. The resulting quantum adapted process <7 
satisfies the following Hudson-Parthasarathy QSDE [11], [22]; 

d(7 = ^((7)df-![(7,L'^]dlT, '^{a):=i[H,a] + &{a), (7) 

where use is made of the Hamiltonian and the coupling operators evolved by the flow jt from ® as 


H(t)=jr(Ho), L(f)=j,(Lo) (8) 

(the flow acts entrywise on vectors and matrices of operators). Also, in d?) denotes the Gorini-Kossakowski-Sudarshan- 
Lindblad (GKSL) decoherence superoperator [6], [18] which acts on (7(f) as 

m 

^ j.k=\ 

= i(LT£2[(7,L] + [LT,(7]£2L) 

= -[(7,LT]nL-i[LT£2L,(7]. (9) 

The third equality in (|9l) is convenient for the entrywise application of the superoperator ^ to vectors of operators. The 
superoperator in (|7]i is referred to as the GKSL generator. The identity (cTo ® ^,^)U = Ua, which holds for system 
operators in view of (|6]l and the unitarity of U{t), allows the QSDE (|2]) to be represented in the Heisenberg picture using 
(l8]i; 

dU = -u[i{Hdt + L^dW) + ]H}Q.Ldty (10) 

Here, use is also made of the property that for any f ^ 0, the future-pointing increments dlT(f) commute with adapted 
processes evaluated at the same (or an earlier) moment of time. In application to the vector X{t) of system variables, the 
flow 

X(f) ■.= \,{Xo)=U{ty{Xo®J^)U{t) (11) 

is understood (also entrywise as mentioned before) in accordance with Q and (|6]l, and the corresponding QSDE 0 is 
representable in a vector-matrix form as 

dX = Fdt + GdW, E:=^(X), G:=-i[X,L\ (12) 


where the «-dimensional drift vector F and the dispersion [n x m)-matrix G consist of time-varying operators. Eurthermore, 
the interaction of the input held with the system produces an nz-dimensional output held 


Y{t):= 


Yiit)' 

Ym{t) 


= uityi.yj^®wit))uit), 


(13) 


where the system-field unitary evolution is applied to the current input field variables (which reflects the innovation nature 
of the quantum Wiener process and the continuous tensor product structure of the Lock space [24]). The output held satisfies 
the QSDE 

dY =2JLdt + dW, (14) 


where the matrix J is given by (HI, and L is the vector of system-field coupling operators from 0. The common unitary 
evolution in (ITTl i and (fOl) preserves the commutativity between the system variables and the output held variables in time 


t ^ 0: 


[x{t)y{tY] = u{ty[Xo®y^,y^,®w{tY]u{t) = Q, 


(15) 
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where the entries of Xq and W{t) commute as operators on different spaces. By a similar reasoning, the output field Y 
inherits the CCR matrix J from the input quantum Wiener process W: 

[y (r), y (r)T] = W{t)'^]U{t) 

=2itju{ty =litj. 

This relation can also be established as a corollary of the property that dydy^ = dVTdVy^ = Hdf in view of Q, (IHi and (fT4l) . 


IV. OPEN QUANTUM HARMONIC OSCILLATOR WITH PARAMETRIC DEPENDENCE 
In a particular case, when the system being considered is an OQHO [3], its dynamic variables satisfy the Heisenberg 
CCRs 

[X[t),X[t)^]=2i@ (16) 

on a dense domain, where the CCR matrix 0 G A„ represents © 0 remains unchanged. The Hamiltonian of the 

OQHO is a quadratic polynomial and the system-field coupling operators in ([T]) are linear functions of the system variables: 

1 T 

H = -X^RX, L = NX, (17) 

where R G S„ and N G are constant matrices. In this case, (fT2li and (fl4li become linear QSDEs 


6X=AXAt + Bm, dY = CXAt + m 


( 18 ) 


(with linear drift F = AX and dispersion matrix G = B with real-valued entries) with constant coefficients which comprise 
the matrices A G B G and C G 

A:=2&{R+n'^JN), B-.= 2@N^, C:=2JN. (19) 


These matrices satisfy the following algebraic equations 

A© + ©A'^-fByB'^ = 0, &C'^ + BJ = 0 


( 20 ) 


which describe the fulfillment of the CCRs (fTbl) and the commutativity (fTSl l at any moment of time and provide necessary 
and sufficient conditions of physical realizability [14] of the linear QSDEs (ITSl l as an OQHO with the CCR matrix 0. 
The first equality in (l20l i can be regarded as an algebraic Lyapunov equation (ALE) with respect to © which has a unique 
solution if and only if the Kronecker sum A0A:=/„(8)A-|-A®/„ is a nonsingular matrix (that is, A has no two eigenvalues 
which are symmetric to each other about the origin of the complex plane). 

Eor general open quantum systems (whose dynamic variables satisfy CCRs, while the Hamiltonian and the coupling 
operators are not necessarily quadratic and linear functions of the system variables, respectively), the CCR preservation 
follows from the unitary evolution of the system variables in (ITTI) . 

Using the standard notation of classical linear control theory [1], [16], the quadruple of the state-space realization matrices 
of the QSDEs (fTSl) . which specify the input-system-output map from W to Y for the OQHO, can be written as 


~ A II R ~ 

. C II Int _ 


( 21 ) 


If the matrices R and N, which specify the Hamiltonian and the coupling operators in ( [TT] ). depend smoothly on a scalar 
parameter e (while W is independent of e), then so do the matrices A, B, C in ( [T9b and the system and output variables 
which comprise the vectors X{t) and Y{t). The derivatives V(f)' := dgX{t) and T(f)' := dgY{t) can be interpreted for any 
f ^ 0 as adapted processes with self-adjoint operator-valued entries satisfying the QSDEs 


dX' = {A'X+AX')dtFB'dW, dY' = {C'X + CX')dt 


( 22 ) 


(the second of which is, in fact, an ODE) with zero initial conditions Xq = Q and Tq = 0 since Xq and lb do not depend on 
e. Here, 

A' = 2@{R’+N’^JN + N'^JN’), B' = 2@N^, C'=2JN' (23) 

are the derivatives of the matrices A, B, C from ( [T9b with respect to e. In combination with (ITSl l. the QSDEs (i22li allow the 

Y 

to be represented in a form, similar to (i2Ti) . as 


input-system-output map from W to 


Y' 


A 

0 

B 1 

A' 

A 

B' 

C 

0 


c 

c 

0 


( 24 ) 
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The special block lower triangular structure of the state dynamics matrix in (l24l i is closely related to the Gateaux derivative 


(e'^)' = [O /„] exp 


A 0]\ 

A' a\) 


In 

0 


of the matrix exponential in the direction A'; see, for example, [10]. At any time f ^ 0, both X{t)' and Y (f)' depend linearly 
on the matrices R' and N' from ( |2^ in view of the following representation of the solutions of the QSDEs (l22l) which 
regards A'Xdt + B'dW as a forcing term; 


where 


X'= f &^'-^'>^{A'X{s)ds + B'dW{s)), (25) 

Jo 

Y'= ( (C'X(i)+CX(i)')di, (26) 

Jo 

Xit)=e‘'^Xo+ [‘e^‘-^^^BdWis) (27) 

Jo 


is the unperturbed solution of the first QSDE in (ITsT l which does not depend on R' or N'. In the case of linear QSDEs, 
whose coefficients depend smoothly on parameters, the mean square differentiability of their solutions with respect to the 
parameters can be verified directly by using the closed form dZTl i (under certain integrability conditions for the underlying 
quantum state). 

The relations (|2^-(|26]| exhaust the analysis of sensitivity of the OQHO to the perturbations of the matrices R and N under 
which the energy operators H and L (ITtT i remain in the corresponding classes of quadratic and linear functions of the system 
variables. However, this analysis is not applicable to more general perturbations (for example, higher order polynomials of 
the system variables) and is restricted to linear systems. 


V. TRANSVERSE HAMILTONIAN 

We will now consider the response of the general open quantum system, described in Section [III] and governed by ([T2l i 
and (O, to perturbation of the system Hamiltonian and the system-field coupling operators; 


Ho 1—^ Ho + £Ko , Lo Lo T £Afo. 


(28) 


Here, Ko and the entries of the m-dimensional vector Mq are self-adjoint operators on the initial system space and e is 
a small real-valued parameter, so that Ko = H'q and Mo = Lq. In what follows, the derivative (•)' ;= de{-) will be taken at 
e = 0. The perturbations Ko and Mq in (I28I) are also assumed to be functions of the system variables which are evolved by 
the unperturbed flow (|6]l as 

K{t)-. = \,{Ko), M{t)-.= ],[Mo). (29) 

Eor example, in the case of the OQHO considered in Section IIVI the perturbations K and M inherit the structure of the 
Hamiltonian and the coupling operators in dnii as a quadratic function and a linear function of the system variables, 
respectively; 

K = M = N'X. (30) 

Returning to the general case, we will avoid at this stage technical assumptions on Ko and Mo in (l28T l. so that the calculations, 
carried out below for arbitrary perturbations, should be regarded as formal. Since the energy operators Ho and Lq completely 
specify the dynamics of the unitary operator U{t) which determines the evolution of the system and output held variables, 
the response of the latter to the perturbation of Ho and Lq reduces to that of U{t). Therefore, the propagation of the initial 
perturbations of the energy operators through the subsequent unitary system-field evolution can be described in terms of the 
operator 

V{t)-.= U{t)', (31) 

which satisfies Vq = 0 since Uo = does not depend on e. The smoothness of dependence of t/(f) on the parameter 

e is analogous to the corresponding property of solutions of classical SDKs (whose drift and dispersion satisfy suitable 
regularity conditions [15], [27]) and holds at least in the linear case discussed in Section HV] 

Theorem I: Eor any time f ^ 0, the operator y(f) in OTl i. associated with the unitary evolution U{t) from (|2]i, is 
representable as 

V{t) = -iU{t)Q{t). (32) 

Here, Q{t) is a self-adjoint operator on which satisfies zero initial condition Qo=0 and is governed by the QSDE 

dQ= {K-lm{L}QM))dt+M'^m. (33) 
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Furthermore, Q{t) depends linearly on the initial perturbations Kq and Mq of the energy operators in ( |28] ) through their 
unperturbed evolutions in ( |29] |. 

Proof: The differentiation of both sides of the unitarity relation t/(f)^[/(f) = with respect to the parameter e 

and letting e = 0 leads to the equalities V^U + t/^F = + t/^F = 0, the second of which implies self-adjointness of 

the operator 

e(f):=/t/(f)V(f), (34) 

thus establishing (l32l i. Now, consider the time evolution of Q{t). To this end, the differentiation of (|2]i with respect to e 
yields 

dV = -{i{Kodt+M^dW) + Re{LlQMo)dt)U-(^i{Hodt + LldW) + ^LlaLQdt'jv. (35) 

By left multiplying both sides of (iTSl l by and recalling (l34l i. it follows that 

U'dV = -i{Kdt +M'^dW) - Re{L^QM)dt + (^^L^Q.Ldt - Hdt - L^dW^ Q, (36) 

where use is made of the evolved perturbations (|29] |. By a similar reasoning, a combination of (fTOl i with (l34l i leads to 

{dU^)V = (j{Hdt+L^dW) - ^L^flLdf^t/V = (Hdt + L^dW + ^L^Q.Ldt'^Q, (37) 

dU'dV = iL^dWU^dV = -iL^dWdW'^{iM + LQ) = - iLQ)dt, (38) 

where use is also made of (l36T l and the quantum Ito product rules [22] in combination with (|3]l. It now follows from (l34l i 
and d^-d^ that 

dQ = /((dt/^)y + U^dV + dt/W) 

= (/: + /L'^nM-/Re(L'^fiM))df+M'^dIT 
= (/:-Im(L'^£2M))df4-M'^dIT, 

which establishes d33] l. The linear dependence of Q{t) on Kq and Mq follows from the integral representation 

<2(0 = {iK{s) - Im(L(i)TfiM(0))di +M(0'^dIT(0) (39) 

of the QSDE d3?t and the property that the evolved perturbations K and M in d29] l depend linearly on Kq and Mq, respectively. 

■ 

In view of Theorem[T] the equation Uf)' = —iU {t)Q{t) has the structure of isolated quantum dynamics in fictitious time 
e, where Q{t) plays the role of a Hamiltonian associated with the perturbation of the unitary operator U{t). In order to reflect 
this property, the time-varying operator Q will be referred to as the transverse Hamiltonian associated with the perturbations 
K and M of the energy operators. Its computation is illustrated below. 

Example 1: In the absence of perturbation to the system-field coupling, when Mq consist of zero operators, the transverse 
Hamiltonian in d39] l reduces to Q{t) = fQK(s)ds. Moreover, if the system is isolated (and hence, the unitary process U in 
dU takes the form t/(f) = e^"^°), then 

Q(t)= f s‘^^«Koe-‘^^«ds= ['e‘^^^‘^o{Ko)ds = tE{itadH,){Ko). 

Jo Jo 

Here, use is made of Hadamard’s lemma [19], and E{z) := (I+TJJ ™ entire function which plays a part in 

the solution of systems of nonhomogeneous linear ODEs with constant coefficients [10]. A 

Example 2: Eor the OQHO of Section IIVI substitution of the perturbations (l30l) into ( |39] | leads to the transverse Hamil¬ 
tonian 

Q{t) =j^ (^X{s)'^{R'+ i{N'^QH'-N''^QH))X{s)ds+X{s)'^N''^dW{s)j 

^lo “ {N@X)t (40) 

which depends in a quadratic fashion on the past history of the system variables. The latter are given by the unperturbed 
equation (i27l i. The last term {N&,N')t in (i40l i comes from the relation lm{i{N'^QN' — N'^HN)) =N'^N' —N''^N (following 
from (13)) and the identity = !(Y,0) which holds for any Y € A„ in view of the CCRs (IT^ . A 
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VI. PERTURBATION ANALYSIS OF SYSTEM OPERATORS 

Since the transverse Hamiltonian Q(t) encodes the propagation of the initial perturbations of the energy operators in (l28l l 
through the unitary system-field evolution over the time interval [0,f], it provides a tool for the infinitesimal perturbation 
analysis of general system operators. The following theorem is concerned with an extended setting which, in addition to 
(l28l l. allows for an initial perturbation in a system operator Ob specified by Cq. 

Theorem 2: For any self-adjoint system operator Oq on the initial space which smoothly depends on the same scalar 
parameter e as in ( |28] ) and is evolved by the flow (|6]l, the derivative of its evolved version a{t) with respect to e is 
representable as 

T(f):=c7(f)'=jr((T^) + 0(f), (^[t):=i[Q{t),a{t)] (41) 

at any time f ^ 0, where Q{t) is the transverse Hamiltonian from Theorem[T] Here, the operator 0(f) satisfies the QSDE 

d0 = {i[Q,<^{a)] + x{(y))At+{[Q\a,L^]]-i[a,M^])AW, (42) 

with zero initial condition 0o = 0, where ^ is the GKSL generator from (|7]), and is a linear superoperator given by 

X{o) := i[K-lm{L^DM), a]-2Re{[a,L^]DM). (43) 

Proof: By using the Leibniz product rule together with (|6l), OTl i. (l3^ and the self-adjointness of 2(f), it follows that 

a' = u\a'Q ® J^)u+ y^((To ® JV)t/ + ® 

= T (c^o) + {-iUQ)H(yo ® - iU\ao ® J^^)UQ 

= it (t^o) + iQU^Oo ® J^^)U - iaQ = ],{a'f) + i[Q, a ], 

which establishes (EB. The equality <Po = 0 follows from Qo = 0. We will now obtain a QSDE for the process 0. To this 
end, by combining the quantum Ito lemma [11], [22] with the bilinearity of the commutator, and using the QSDEs (|2l) and 
(i33l l. it follows that 

d[e,(j] = [de,(j] + [e,da]-f[de,d(j] 

= [/:-Im(L'^£2M),(j]df- [(7,M^]dW-f [2,^(c7)]df-f[2,[(7,L’^]]dW- [M’^dW,i[(J,L'^]dW] 

= (IK- Im(LTfiM), a] -b [Q,^{a)\ + 2ilm{i[a,LJ]TlM))At - {[a,M'^] + i[Q, [(7,LT]])dW 

= ([/:-Im(L’^f2M),(7]-b[2,^((j)]-b2fRe([(7,L’^]f2M))df- ([(7,M'^]-bi[2,[(7,L’^]])dW. (44) 

Here, the quantum Ito product rules are combined with the commutativity between adapted processes and future-pointing 
increments of the quantum Wiener process. In the second and third of the equalities (l44li . use is also made of the relations 
[a, jS^dVT] = [a,P^]dW and [a^dW, jS^dVT] = 2flm(a^nj3)df for appropriately dimensioned adapted processes a and j3 with 
self-adjoint operator-valued entries. These are combined with the identity Im(/[(7,L^]f2M) = Re([(7,L^]f2M) in the fourth 
equality of (i44l i. The QSDE (i42l i can now be obtained my multiplying both sides of (i44l i by i and using (l43T l. ■ 

The process jr(<7Q) in (HTI) is the response of (j(f) to the initial perturbation cJq of the system operator under the unperturbed 
flow (|6]l and satisfies the QSDE 0: 

dj,(c7^) =^^Or((^o))df-i[jr((T^),T^]dW. (45) 

The operator 0(f) in (l4Tli describes the response of the flow f itself to the perturbation of the energy operators and will be 
referred to as the derivative process for the system operator <7. Accordingly, the term i[Q,‘if{a)] in the drift of the QSDE 
(i42l i is the derivative process for ^#((7). The last equality in (i4TI) is organized as the right-hand side of the Heisenberg ODE 
(in fictitious time e) of an isolated quantum system with the state space Jif®^ and the transverse Hamiltonian 2(f). While 
the unperturbed flow jr((70) depends linearly on <7 q, the derivative process 0(f) depends linearly on the perturbations Kq and 
Mo of the energy operators through the transverse Hamiltonian Q and the superoperator x in (l43] l. 

In application to the vectors X and L of the system variables and system-field coupling operators in 0, the QSDEs (l42li . 
(|45 T i and the definition (l43T l lead to 

AX' =(f([/:-Im(L^f2M),Y] -b [2,E]) +2Im(GfiM))df 

+ i([2,G]-[Y,MT])dW, (46) 

dL' ={^{M) + i{[K-lvcL{LjQM),L] + [2,^(T)]) -2Re([L,L^]f2M))df 

+ ([2, [L,L^]] - i[L,M'^] - i[M,L^])dW, (47) 

where F and G are the drift vector and the dispersion matrix from ([T2l i. In (i46T l. use is also made of the absence Xq=Q 
of initial perturbations in the system variables, whereby jf(YQ) = 0 for any f ^ 0. Furthermore, in (i47l i. we have used the 
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relations = jr(A/o) =M{t) in view of (l28T l. ( |29] |. Since the matrix J and the quantum Wiener process W do not depend 
on the parameter e, the derivative of the output field Y of the system in (fT4l i evolves according to the ODE 

{¥')' = 2JL', (48) 

where ( )' denotes the time derivative, and L' is governed by the QSDE Wt\ . 

In particular, for the OQHO of Section |IV] with the perturbations (l30l l of the energy operators, the QSDEs (I46l l- (l48l l lead 
to the relations (l22l i. (|2^ which were obtained in Section |IV] using more elementary techniques. However, the latter are 
limited to the class of linear-quadratic perturbations (l30l) which inherit the structure of the corresponding energy operators, 
whereas the transverse Hamiltonian approach allows the system response to be investigated for general perturbations of the 
energy operators. Therefore, this approach can be used for the development of optimality conditions in coherent quantum 
control problems for larger classes of controllers and filters. 

VH. SENSITIVITY OE QUANTUM AVERAGED PEREORMANCE EUNCTIONALS 

Eollowing the classical control paradigm for stochastic systems [1], [16], suppose the desired operation of the quantum 
system being considered over an infinite time horizon corresponds to small values of an averaged cost functional 

^:=limEZ(f), (49) 

r^+co 

provided the limit exists. The latter assumption guarantees the same Cesaro limit lim,_ 5 .+„o (| /QEZ(i)di) = 3Y. The expec¬ 
tation E(-) is taken over the tensor product p := IU<S>V of the initial quantum state CU of the system and the vacuum state 
V in the boson Eock space ^ for the external fields. Also, it is assumed that Z (which will be referred to as the criterion 
process) is an adapted quantum process given by 

Z(f):=/(V(f),L(f)). (50) 

Here, / : R"+”' —M is a function which is extended to the noncommutative system variables and the “signal” part 2JL 
of the output field in (O so as to make Z(f) a self-adjoint operator for any f ^ 0 (note that det7 7 ^ 0 in view of (jUi). 
Such extension is straightforward in the case of polynomials and can be carried out through the Weyl quantization [4] for 
more general functions. In the CQLQG control and filtering problems [21], [28], [29], the function / in (iSOl l is a positive 
semi-definite quadratic form. Now, if the energy operators of the quantum system are subjected to perturbations (i28l l. then 
by using the transverse Hamiltonian Q from Theorem [T] in combination with Theorem |2] it follows that 

(EZ(f))'=E(j,(Z') + 0(f)), <j)(f):=i[e(f),Z(f)]. (51) 

Here, Zq can be nonzero due to the dependence on L in (fSOl) despite X'^ = 0, and (j) is the derivative process for Z. Ignoring, 
at this stage, the technical issues of existence and interchangeability of appropriate limits, dSB leads to the following 
perturbation formula for the cost functional in (l49l i: 

;= ^hm^(Ej,(z;) +E0(f)). (52) 

The right-hand side of ( [52] ) is a linear functional of the perturbations Kq and Mq which describes the corresponding (formal) 
Gateaux derivative of Therefore, the quantum system is a stationary point of the performance criterion ( [49] ) with respect 
to a subspace ^ of perturbations {Kq,Mo) of the energy operators in (i28l l. if ^ is contained by the null space of the linear 
functional in (i52l) : 

(53) 

While limr^.+ooEjr(ZQ) in (1521) reduces to averaging over the invariant state of the unperturbed system (provided the latter 
is ergodic and certain integrability conditions are satisfied), the computation of lim,^+ooE0(f) is less straightforward. Due 
to the product structure of the system-field state p (with the external fields being in the vacuum state), the martingale part 
of the QSDE (i42l i does not contribute to the time derivative 

(E(j))‘=Ev/ + E;t(Z), W-=i[Q,^iZ)]. (54) 

where \j/ is the derivative process for ^^(Z), and the superoperator x from (@3) is applied to the criterion process Z. The 
relation (i54l i is a complicated integro-differential equation (IDE). However, this IDE admits an efficient solution, for example, 
in the case when the system is an OQHO, and the function / in (fSOl) is a polynomial. In this case, due to the structure of 
the GKSL generator of the OQHO, ^^(Z) is also a polynomial of the system variables of the same degree, thus leading to 
a linear relation (with constant coefficients) between the derivative processes 0 and y/, and algebraic closedness in the IDE 
dUl). Therefore, for OQHOs with a Hurwitz matrix A and a polynomial criterion process Z, the computation of (and 
verification of the stationarity condition (fSSl l) reduces to averaging over the unperturbed invariant state (which is unique and 
Gaussian). 


Example 3: Consider the OQHO of Section |IV] described by (fT6])-(fT9b with a Hurwitz matrix A. Suppose the criterion 
process Z in (fSOl) is a quadratic form: 


Z:=-[X^ 




n:= 


Hii Tin 
Till TI22 


(55) 


where the 5 factor is introduced for further convenience, 11 G is a given appropriately partitioned weighting matrix, 
and P G §+ is an auxiliary matrix: 


p '.= rill + iii2^ ^^n2i +A^^n22A^- 


(56) 


Then, in view of Xq = 0, it follows from (l55l l and ( l29b that 

ji(Z^,) =Re((n 2 iZ + n 22 L)'^M) =Re(zT(ni 2 +A^'^n 22 )M). (57) 

The second equality in (l55] t allows the quantum average of the corresponding derivative process (j) in (l5Tl t to be represented 
as 

E0 = i(P,T), T:=/E[2,E], E := Re(ZZ’^) = -10. (58) 

Here, T is the expectation of the derivative process 1[2,E] for E and hence, satisfies the following IDE, similar to (l54l i: 

t = /E[e,^^(E)]+Ex(E), (59) 

where the superoperator X from ( |4^ is applied to E entrywise as 

XiXjXk) = i[K~lm{L^aM),XjXk]-2Re{[XjXi„L^]aM) 

= i[K- lm{x'^N'^QM) , XjXk] + 41m( {Xk@j. + Xj&k,) n'^QM) , (60) 

with 0^, the ^th row of the CCR matrix 0. By substituting the Hamiltonian and coupling operators of the OQHO from ([TtI i 
into the GKSL generator ^'m ^ and (|9]l and using the CCRs ( fThl l together with the state-space matrices ( fT^ , it follows 
that 

1^{Z)=AZ + ZA^ + BB^. (61) 

Substitution of dMl l into ( |59] | reduces the IDE to a Lyapunov ODE: 

T = /E[e, AE + EA't + BB^] + E;;; (E) = AT + TA'^ + Ej (E). (62) 


Since the matrix A is Hurwitz, the unperturbed OQHO is ergodic and its invariant state is Gaussian with zero mean 
EZ = 0 and covariance matrix E(ZZ^) = E-f 10, where E is a unique solution of the ALE AE + EA^ = 0. Therefore, 
under integrability conditions for z(^)’ to be discussed elsewhere, the solution of the Lyapunov ODE (l62l i has a limit 
Too := limf^+ooT(f) which is a unique solution of the ALE 

AToo + YocA^ -p ^ liin^E;^ (S) = 0, (63) 

where lim,_>+ooE;|^(E) can be computed by averaging z(^) over the invariant Gaussian state of the OQHO. Therefore, by 
assembling (l57l i and (fSSl) into (l52l i. it follows that 

= lim ERe(AT(ni 2 +lvTn 22 )M) + ^(P,To„), (64) 

where the limit also reduces to averaging over the invariant Gaussian state. The relations (l56l) . (l60l l. (l 6 ^ and dMl i express 
the Gateaux derivative of the quadratic cost functional ( |49] |. specified by (l55l) . in terms of mixed moments of the 
system variables X and the perturbations K and M over the invariant Gaussian quantum state. In particular, if K and M are 
polynomials of the system variables, such moments can be computed using the Isserlis-Wick theorem [13]. If A" and M are 
trigonometric polynomials, that is, linear combinations of unitary Weyl operators e'" with u G M”, the moments can also 
be computed using quantum Price’s theorem [30], which will be discussed elsewhere. A 
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CO 


Fig. 1. The series connection of a quantum plant and a quantum filter, mediated by the field Y and affected by the environment through the quantum 
Wiener processes W, co. The signal part of the filter output rj is to approximate the plant variables of interest in the mean square sense. 


VIII. MEAN SQUARE OPTIMAL COHERENT QUANTUM EILTERING PROBLEM 


We will now outline an application of the transverse Hamiltonian technique of Sections IVl - IVIIl to a quantum filtering 
problem. Let the open quantum system, described in Section [nil be interpreted as a quantum plant. Recall that it has the 
Hamiltonian H, system-field coupling L, input field W, dynamic variables X and output field Y governed by the QSDEs (fTSl i 
and (fT4l i. Suppose the plant is cascaded with another open quantum system, further referred to as the filter, which is driven 
by Y and a /r-dimensional quantum Wiener process O) on a boson Fock space see Fig. [1] The filter is endowed with 
its own initial Hilbert space Yj, dynamic variables (f),..., (0 with a CCR matrix A G Ay, and an {m -f /r)-dimensional 

output field 77 (f); 



■^r 


■®r 


J?i 



, (o:= 


, V ■■= 









We denote the filter Hamiltonian by F and the vectors of operators of coupling of the filter with the plant output Y and the 
quantum Wiener process (0 by 


'or 




II 


1 

s 

_1 


- 1 

3 , 

_1 


( 66 ) 


respectively. The Hamiltonian F and the coupling operators <I>i,..., <I>„, and ‘Ti,..., are functions of the dynamic variables 
,..., of the filter and hence, commute with the plant variables and functions thereof, including H and L. The plant and 
filter form a composite open quantum stochastic system, whose vector of dynamic variables satisfies the CCRs 


[JT, JTT] =2/0, 


© 

0 A ’ 



and is driven by an augmented quantum Wiener process W with the Ito table 


(67) 


dir dir ^ = i7df, i2.= 

Here, 13 denotes the Ito matrix of the quantum Wiener process co of the filter, which is defined similarly to £2 from Q and 
(|4]i as 

dtudw^ = I5df, 13 :=!^ + /J 0/^/2, (69) 


ir := 


( 68 ) 


where the dimension 71 is also assumed to be even. The quantum feedback network formalism [ 8 ] allows the Hamiltonian 
H of the plant-filter system and the vector L of operators of coupling with iT to be computed as 


H = //-fF + 4>’^7L, 


L + 4> 


(70) 


Hence, the filter variables are governed by the QSDF 

d^ = G(^ )df - /[^ ,LT]dir = (/[F, + A(^ ))df - /[^, [OT q/T] ] d 


(71) 


Here, G(i^) := /[H,i^] -t-D(i^) is the GKSL generator of the plant-filter system, and D(i^) = — [i^,L^]17L— is 

the corresponding decoherence superoperator, similar to @. In ItTI) . use is also made of the partial GKSL decoherence 
superoperator A which acts on the filter variables as A(^) = — [^,<I>^]£2<I>— 5[4>^£24> + ‘P^G'T,^] in view of 

(|67li-(|70ll. Now, consider a CQF problem which is formulated as the minimization of the mean square discrepancy 

J^:=^hm EZ(f )—7 min, Z := ^{SX - Thf {SX - TL) (72) 
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between r linear combinations of the plant variables of interest and filter output variables specified by given matrices S G 
and T := [^i Tj\, with Ti € T 2 € (note that, similarly to (fl4l i. 2Imf7L is the signal part of 77 in view of dbSl) 

and (l 68 ]) l. The criterion process Z in (|72]i is similar to that in (l55l i: 


Z 





-S^f 

y'T 'Y ’ 


(73) 


with only the subvector X of from (IFTl i being present in 17^ . The minimization in (l72l) is carried out over the filter 
Hamiltonian T and the vector <I> of the filter-plant coupling operators in (l66l) . This problem extends [29] in that we do not 
restrict attention to linear filters even if the plant is an OQHO and ^ depends linearly on the filter variables If To and 
<I>o are perturbed in the directions 

Kq := Tq, Mo ;= 4>o, (74) 


consisting of self-adjoint operators representable as functions of the filter variables, the corresponding perturbations of the 
plant-filter Hamiltonian and coupling operators in (fTOl i are 


H'o = Ko +mIjLo, 



(75) 


By applying Theorem[T] and using dMl l. (l74l i and (l75l l. the corresponding transverse Hamiltonian Q for the plant-filter system 
satisfies the QSDE 


dQ= (K + M'^JL-lm(y'f2 “ ))df-|- [M^ 0]dW 
= {K-lm{{2L + <i>fflM))dt+M'^dW, 


(76) 


where use is also made of Im(L^nM) = —M^JL (following from Q and the commutativity [L,M^] = 0). Then the Gateaux 
derivative of the cost functional in (l72l i is given by (l52l i. where in view of (I73I) and (fTSi) (and similarly to (l57]) ). 


j,(Z')=Re((7’L-5Z)TriM). 


In accordance with ( l54b , the expectation of the derivative process 0 ;= i[Q,Z] satisfies the IDE 


(E0)-=/E[e,G(Z)]+E;t(Z), 

where, in view of (l76l l. the superoperator % in •EJ is given by 

X (Z) = i[K-\m{{2L + 4>)'^f2M),Z] - 2Re([Z, (L + . 


Therefore, in the case when both the plant and the unperturbed filter are OQHOs with Hurwitz dynamics matrices (while 
the perturbations in (l74l i are not necessarily linear-quadratic), iF' can be computed explicitly along the lines of Example [3] 
of Section IVTIl due to Z being a quadratic form of the plant-filter variables ^. The transverse Hamiltonian method, outlined 
above, has recently been used in [31] to show that, in the mean square optimal CQE problem for linear plants, linear filters 
can not be improved locally (in the sense of first-order optimality conditions) by varying the energy operators of the filter 
along the Weyl operators. 


IX. CONCLUSION 

Eor a class of open quantum systems governed by Markovian Hudson-Parthasarathy QSDEs, we have introduced a 
transverse Hamiltonian and derivative processes associated with perturbations of the energy operators. This provides a 
fully quantum tool for infinitesimal perturbation analysis of system operators and averaged cost functionals. The proposed 
variational method can be used for the development of optimality conditions in coherent quantum control problems. We 
have illustrated these ideas for OQHOs with quadratic performance criteria and the mean square optimal CQE problem. 


References 

[1] B.D.O.Anderson, and J.B.Moore, Optimal Control: Linear Quadratic Methods, Prentice Hall, London, 1989. 

[2] D.Dong, and I.R.Petersen, Quantum control theory and applications: a survey, lET Contr Theor. AppL, vol. 4, no. 12, 2010, pp. 2651-2671. 

[3] S.C.Edwards, and V.P.Belavkin, Optimal quantum filtering and quantum feedback control, arXiv:quant-ph/0506018Y2, August 1, 2005. 

[4] G.B.Folland, Harmonic Analysis in Phase Space, Princeton University Press, Princeton, 1989. 

[5] C.W.Gardiner, and P.Zoller, Quantum Noise, 3rd Ed., Springer, Berlin, 2004. 

[6] V.Gorini, A.Kossakowski, and E.C.G.Sudarshan, Completely positive dynamical semigroups of A-level systems, J. Math. Phys., vol. 17, no. 5, 1976, 
pp. 821-825. 

[7] J.Gough, V.P.Belavkin, and O.G.Smolyanov, Hamilton-Jacobi-Bellman equations for quantum optimal feedback control J. Opt. B: Quant. Semiclass. 
Opt., vol. 7, 2005, pp. S237-S244. 

[8] J.Gough, and M.R.James, Quantum feedback networks: Hamiltonian formulation, Commun. Math. Phys., vol. 287, 2009, pp. 1109-1132. 

[9] A.S.Holevo, Quantum stochastic calculus, J. Math. Sci., vol. 56, no. 5, 1991, pp. 2609-2624. 

[10] N.J.Higham, Functions of Matrices, SIAM, Philadelphia, 2008. 


11 










[11] R.L.Hudson, and K.R.Paithasarathy, Quantum Ito’s Formula and Stochastic Evolutions, Commun. Math. Phys., vol. 93, 1984, pp. 301-323. 

[12] KJacobs, and RL.Knight, Linear quantum trajectories: applications to continuous projection measurements, Phys. Rev. A, vol. 57, no. 4, 1998, pp. 
2301-2310. 

[13] S.Janson, Gaussian Hilbert Spaces, Cambridge University Press, Cambridge, 1997. 

[14] M.R.James, H.I.Nurdin, and I.R.Petersen, H°° control of linear quantum stochastic systems, IEEE Trans. Automat. Contr, vol. 53, no. 8, 2008, pp. 
1787-1803. 

[15] I.Karatzas, and S.E.Shreve, Brownian Motion and Stochastic Calculus, 2nd Ed., Springer-Verlag, New York, 1991. 

[16] H.Kwakernaak, and R.Sivan, Linear Optimal Control Systems, Wiley, New York, 1972. 

[17] L.D.Landau, and E.M.Lifshitz, Statistical Physics, 3rd Ed., Elsevier, Amsterdam, 1980. 

[18] G.Lindblad, On the generators of quantum dynamical semigroups, Commun. Math. Phys., vol. 48, 1976, pp. 119-130. 

[19] E.Merzbacher, Quantum Mechanics, 3rd Ed., Wiley, New York, 1998. 

[20] Z.Miao, and M.R.James, Quantum observer for linear quantum stochastic systems, Proc. 51st IEEE Conf. Decision Control, Maui, Hawaii, USA, 
December 10-13, 2012, pp. 1680-1684. 

[21] H.I.Nurdin, M.R.James, and I.R.Petersen, Coherent quantum LQG control, Automatica, vol. 45, 2009, pp. 1837-1846. 

[22] K.R.Paithasarathy, An Introduction to Quantum Stochastic Calculus, Birkhauser, Basel, 1992. 

[23] K.R.Paithasarathy, What is a Gaussian state? Commun. Stoch. Anal., vol. 4, no. 2, 2010, pp. 143-160. 

[24] K.R.Paithasarathy, and K.Schmidt, Positive Definite Kernels, Continuous Tensor Products, and Central Limit Theorems of Probability Theory, Sprinser- 
Verlag, Berlin, 1972. 

[25] I.R.Petersen, Quantum linear systems theory, Proc. 19th Int. Symp. Math. Theor. Networks Syst., Budapest, Hungary, July 5-9, 2010, pp. 2173-2184. 

[26] A.K.Sichani, I.G. Vladimirov, and I.R.Petersen, A gradient descent approach to optimal coherent quantum LQG controller design, accepted at American 
Control Conference, 2015, preprint: arXiv: 1502.00274 1 February 2015. 

[27] D.W.Stroock, Partial Differential Equations for Probabilists, Cambridge University Press, Cambridge, 2008. 

[28] I.G.Vladimirov, and I.R.Petersen, A quasi-separation principle and Newton-like scheme for coherent quantum LQG control, Syst. Contr. Lett., vol. 
62, no. 7, 2013, pp. 550-559. 

[29] I.G.Vladimirov, and I.R.Petersen, Coherent quantum filtering for physically realizable linear quantum plants, Proc. European Control Conference, 
IEEE, Zurich, Switzerland, 17-19 July 2013, pp. 2717-2723. 

[30] I.G.Vladimirov, A quantum mechanical version of Price’s theorem for Gaussian states, Proc. Australian Control Conference, AUCC 2014, IEEE, 
Canberra, Australia, 17-18 November 2014, pp. 118-123. 

[31] I.G.Vladimirov, Weyl vaiiations and local sufficiency of lineai* observers in the mean squai'e optimal coherent quantum filtering problem, submitted, 
preprint: ai'Xiv: 1506.07653 [quant-ph], 25 June 2015. 


12 


